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DETAILED ACTION 



Claims 14-52 are withdrawn from furtlier consideration pursuant to 37 CFR 1 .142(b) as 
being drawn to a nonelected subcombination, tliere being no allowable generic or 
linking claim. Election was made without traverse in the reply filed on October 28, 
2008. 



Claim Rejections - 35 USC § 101 



1. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

The USPTO "Interim Guidelines for Examination of Patent Applications for Patent 
Subject Matter Eligibility" (Official Gazette notice of 22 November 2005), Annex IV, 
reads as follows (see also MPEP 2106): 

Descriptive material can be charactehzed as either "functional descriptive material" or "nonfunctional 
descriptive material." In this context, "functional descriptive material" consists of data structures and 
computer programs which impart functionality when employed as a computer component. (The 
definition of "data structure" is "a physical or logical relationship among data elements, designed to 
support specific data manipulation functions." The New IEEE Standard Dictionary of Electhcal and 
Electronics Terms 308 (5th ed. 1993).) "Nonfunctional descriptive material" includes but is not limited 
to music, literary works and a compilation or mere arrangement of data. 

When functional descriptive material is recorded on some computer-readable medium it becomes 
structurally and functionally interrelated to the medium and will be statutory In most cases since use of 
technology permits the function of the descriptive material to be realized. Compare In re Lowry, 32 
F.3d 1579, 1583-84, 32 USPQ2d 1031, 1035 (Fed. Cir. 1994) (claim to data structure stored on a 
computer readable medium that increases computer efficiency held statutory) and Warmerdam, 33 
F.3d at 1 360-61 , 31 USPQ2d at 1 759 (claim to computer having a specific data structure stored in 
memory held statutory product-by-process claim) with Warmerdam, 33 F.3d at 1361, 31 USPQ2d at 
1760 (claim to a data structure per se held nonstatutory). 

In contrast, a claimed computer-readable medium encoded with a computer program is a computer 
element which defines structural and functional interrelationships between the computer program and 
the rest of the computer which permit the computer program's functionality to be realized, and is thus 
statutory. See Lowry, 32 F.3d at 1583-84, 32 USPQ2d at 1035. 
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Claims 12 and 13 are rejected under 35 U.S.C. 101 as not falling within one of 
the four statutory categories of invention. Supreme Court precedent^ and recent 
Federal Circuit decisions^ indicate that a statutory "process" under 35 U.S.C. 101 must 
(1) be tied to another statutory category (such as a particular apparatus), or (2) 
transform underlying subject matter (such as an article or material) to a different state or 
thing. While the instant claim(s) recite a series of steps or acts to be performed, the 
claim(s) neither transform underlying subject matter nor positively tie to another 
statutory category that accomplishes the claimed method steps, and therefore do not 
qualify as a statutory process. For example, the calculation step of claim 12 should be 
tied to a specific apparatus. 

Claim Rejections - 35 USC §112 

2. The following is a quotation of the second paragraph of 35 U.S.C. 1 1 2: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

3. Claim 6 is rejected under 35 U.S.C. 112, second paragraph, as being indefinite 
for failing to particularly point out and distinctly claim the subject matter which applicant 

regards as the invention. The language "on time series" is unclear. It is presumed the 
applicant means "on time series data". Appropriate correction of the language to enable 
clear interpretation of the meaning of the claim is required. 

' Diamond v. Diehr, 450 U.S. 175, 184 (1981); Parker v. Flook, 437 U.S. 584, 588 n.9 (1978); Gottschalk v. 
Benson, 409 U.S. 63, 70 (1972); Cochrane v. Deener, 94 U.S. 780, 787-88 (1876). 
^ In re Bilski, 88 USPQ2d 1385 (Fed. Cir. 2008). 
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Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the phor art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 1 and 12 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Gallagher (US 2003/0215230 A1). 

Regarding claim 1, Gallagher discloses an image processing apparatus (imaging 
system, [0009], shown with CPU in fig. 4) comprising a distortion correcting unit (system 

for correcting distortion, [0010], processor, [0039]), the image processing apparatus 
further comprising a distortion correcting range calculating unit that calculates an input 
image range (preferably output image has same number of rows and columns as input 
image, if i(xo, yo) falls outside the range of the image i(x,y), then value of o(mo, no) is 
set to a default value, [0027]; distortion model governs the mapping of locations of the 
output image to locations in the input image, [0028], [formula to find xo, yo, included in 
[0028]]; since value is set to a default if it falls outside of a given range, it indicates the 
range is being determined). 
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Gallagher does not explicitly disclose the input image range for distortion correction 
processing performed by the distortion correcting unit. However, as a distortion model 
governs the mapping of locations of the output image to locations in the input image 
([0028], [formula to find xo, yo, included in [0028]]), and a matching is occurring 
between the range of coordinates of the input and output image (if i(xo, yo) falls outside 
the range of the image i(x,y), then value of o(mo, no) is set to a default value, [0027]; 
since value is set to a default if it falls outside of a given range, it indicates the range is 
being determined), it would be obvious at the time of the invention to one of ordinary 
skill in the art that in finding this input image range, and the input image is corrected for 
distortion, the distortion correction range is also being determined. 

Regarding claim 12, Gallagher discloses an image processing method for distortion 
correction processing (title), wherein an input image range is calculated (preferably 
output image has same number of rows and columns as input image, if i(xo, yo) falls 
outside the range of the image i(x,y), then value of o(mo, no) is set to a default value, 
[0027]; distortion model governs the mapping of locations of the output image to 
locations in the input image, [0028], [formula to find xo, yo, included in [0028]]; since 
value is set to a default if it falls outside of a given range, it indicates the range is being 
determined). 
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Gallagher does not explicitly disclose the input image range for distortion correction 
processing is calculated. However, as a distortion model governs the mapping of 
locations of the output image to locations in the input image ([0028], [formula to find xo, 
yo, included in [0028]]), and a matching is occurring between the range of coordinates 
of the input and output image (if i(xo, yo) falls outside the range of the image i(x,y), then 
value of o(mo, no) is set to a default value, [0027]; since value is set to a default if it falls 
outside of a given range, it indicates the range is being determined), it would be obvious 
at the time of the invention to one of ordinary skill in the art that in finding this input 
image range, and the input image is corrected for distortion, the distortion correction 
range is also being determined. 

Gallagher also does not explicitly disclose the input image range is calculated at the 
time of the distortion correction processing. However, as Gallagher discloses the bar 
code is read to determine distortion parameters for a type of film as it is scanned in, 
[0039], it would have been obvious at the time of the invention to one of ordinary skill in 
the art that range would also be determined at the time of correction. 

6. Claim 2 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Gallagher (US 2003/0215230 A1) as applied to claim 1 above, in viewof Suda (US 
20020122124 A1). 
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Regarding claim 2, Gallagher discloses the image processing apparatus according to 
claim 1. Gallagher further discloses the distortion correcting range calculating unit 
comprises: a coordinate generating unit that generates interpolation coordinates (the 
value of the pixel o(mo, no) [coordinate] is determined by interpolating the value from 
the pixel values nearby i(xo, yo), [0027]); a distortion-correction coordinate transforming 
unit (output image is generated by the distortion corrector, [0027], distortion model to 
map output image locations (m, n) to locations x, y of input image, [0028]); and a 
correcting range detecting unit that calculates input image range from the transformed 
coordinate position (preferably output image has same number of rows and columns as 
input image, if i(xo, yo) falls outside the range of the image i(x,y), then value of o(mo, 
no) is set to a default value, [0027]; distortion model governs the mapping of locations of 
the output image to locations in the input image, [0028], [formula to find xo, yo, included 
in [0028]] since value is set to a default if it falls outside of a given range, it indicates the 
range is being determined). 

Gallagher does not explicitly disclose a distortion-correction coordinate transforming unit 
that outputs a coordinate transformed by applying a predetermined distortion correcting 
formula to the generated interpolation coordinate. 

Suda teaches a distortion-correction coordinate transforming unit that outputs a 
coordinate transformed by applying a predetermined distortion correcting formula to the 
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generated interpolation coordinate (interpolation to correct misregistration, [0130]; 
subsequent distortion correction, [0131]). 

Gallagher and Suda are in the similar art of correcting image distortion (Gallagher, title, 
Suda, [01 31 ], [01 36]). It would have been obvious at the time of the invention to one of 
ordinary sl<ill in the art to substitute the sequential interpolation and distortion correction 
as taught by Suda for the distortion correction that is also interpolation as taught by 
Gallagher, because when taking images with a photographing lens, Suda states the 
reason this interpolation is done before distortion correction, is that due to shifts of 
object images caused by expansion or shrinkage of the photographing lens, the 
direction of misregistration has deviated from that parallel to the plane of the paper after 
distortion correction, and interpolation cannot be implemented by simple arithmetic 
([0136]). 

7. Claim 3 4 and 5 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Gallagher (US 2003/0215230 A1) and Suda (US 20020122124 A1) as applied to claim 
2 above, further in view of Nako (US 5940544 A). 

Regarding claim 3, Gallagher and Suda disclose the image processing apparatus 
according to claim 2. Gallagher and Suda do not explicitly disclose the coordinate 
generating unit generates the interpolation coordinates by using only coordinates 
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corresponding to pixels of a peripheral portion of a side of an output image range after 
distortion correction processing. 

Nako teaches a height calculation section calculates from the edge a height of the 
document, and subsequently a distortion correction section corrects a distortion by 
magnification/reduction of the picture rotated by the rotation correction section on the 
basis of the document height and the magnification (abstract). This indicates the 
correction is being performed based on the edges. 

Though Nako does not explicitly teach using only these pixels on the edges exclusively, 
in the explanation that these peripheral pixels are the pixels causing these major 
distortions when imaging books, it would have been obvious at the time of the invention 
to one of ordinary skill in the art to use these pixels exclusively in the mapping, as this 
would reduce computation time. 

Gallagher, Suda, and Nako are in the similar art of distortion correction (Gallagher, title, 
Suda, [0131], [0136], Nako, title). It would have been obvious at the time of the 
invention to one of ordinary skill in the art to combine the rectangular input image and 
using only coordinates regarding the sides with the invention of Gallagher and Suda 
because as taught by Nako, skew can be detected based on the edges (abstract). 
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Regarding claim 4, Gallagher, Suda, and Nako disclose the image processing 
apparatus according to claim 3. 

Nako further teaches a rectangular paper (col. 8, lines 65-68), in which a height 
calculation section calculates from the edge a height of the document, and 
subsequently a distortion correction section corrects a distortion by 
magnification/reduction of the picture rotated by the rotation correction section on the 
basis of the document height and the magnification (abstract). This indicates the 
correction is being performed based on the edges. 

It would have been obvious at the time of the invention to one of ordinary skill in the art 
to combine the rectangular input image with the invention of Gallagher and Suda, 

because as taught by Nako, in the case of determining skew in order to correct 
distortion in documents, the start image from which these skew values are being 
derived from will generally be rectangular (col. 8, lines 65-68). 

Regarding claim 5, Gallagher, Suda, and Nako disclose the image processing 
apparatus according to claim 4. 

Nako further teaches selecting an appropriate processing area in accordance with the 
skew (col. 5, lines 35-40), wherein a skew detection means determines a maximal and 
minimal point from among the edges to detect the skew angle (col. 5, lines 50-55). 
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Because the processing range is changed in accordance with skew, and skew is 
determined using the maximum and minimum of the sides (edges), this shows the 
range calculation in this instance is based on maximum and minimum values of the 
coordinates of the pixels corresponding to the four sides of the output image range. 

8. Claim 6 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Gallagher (US 2003/0215230 A1) and Suda (US 20020122124 A1) as applied to claim 
2 above, further in view of Song (US 20020164083 A1). 

Regarding claim 6, Gallagher and Suda disclose the image processing apparatus 
according to claim 2. 

Gallagher and Suda do not explicitly disclose the distortion-correction coordinate 
transforming unit performs the calculation included in the predetermined correcting 
formula on time-series. 

Song teaches a controller for interpolating the image stored in the first frame memory on 
a real time basis and prewarping it by using the distortion correction information stored 
in the distortion correcting memory, ([0151], [0160]). Examiner interprets acting on the 
images in real-time as indicative of performing a calculation on time-series. 
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Gallagher, Suda, and Song are In the similar art of correcting image distortion 
(Gallagher, title, Suda, [0131], [0136], Song, title). It would have been obvious at the 
time of the invention to one of ordinary skill in the art to use the transforming unit on a 
time series, such as that taught by Song, with the apparatus disclosed by Gallagher and 
Suda, as video data is a common application for image analysis which would require 
processing multiple frames over a span of time. 

9. Claim 7 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Gallagher (US 2003/0215230 A1) and Suda (US 20020122124 A1) as applied to claim 
2 above, further in view of Suzuki et al. (US 6801671 B1 ). 

Regarding claim 7, Gallagher and Suda disclose the image processing apparatus 
according to claim 2. 

Gallagher and Suda do not explicitly disclose the coordinate generating unit obtains 
coordinates by performing predetermined thinning-out processing with respect to the 
interpolation coordinates for distortion correction processing. 

Suzuki et al. teach, "In the case of reduction, in order to prevent such processing from 
causing a deterioration in image quality, after interpolation of the pixel data is carried out 
by the reducing interpolation unit in accordance with the reduction ratio, the interpolated 
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pixel data is thinned out by the reduction/enlargement unit and the image is reduced", 
(col. 1, lines 45-55). 

It would have been obvious at the time of the invention to one of ordinary skill in the art 
to combine the thinning out as taught by Suzuki et al. with the invention of Gallagher 
and Suda, as this is described by Suzuki et al. as part of conventional magnification 
processing (col. 1 , lines 55-65), therefore this would have been a known way to perform 
this and would have predictable results. 

10. Claim 8-11 and 13 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Gallagher (US 2003/0215230 Al) as applied to claims 1 and 12 above, further in 
view of Song (US 200201 64083 Al ). 

Regarding claim 8, Gallagher discloses the image processing apparatus according to 
claim 1 . Gallagher does not explicitly disclose the distortion correcting range calculating 
unit calculates the input image range by sequentially repeating the range calculation 
with respect to a plurality of input signals for distortion correction processing. 

Song et al. teach coordinates are successively updated based on which a distortion is 
corrected, and the process is repeatedly performed until the size of a scaled-up or 
scaled-down image is determined suitable to the screen ([0144]), and indicate multiple 
images ([0151], [0160]). 
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Gallagher and Song are in the similar art of correcting image distortion (Gallagher, title. 
Song, title). It would have been obvious at the time of the invention to one of ordinary 
skill in the art to use successive updating based on multiple images, such as that taught 

by Song, with the apparatus disclosed by Gallagher, as this will help refine the 
processing for a variety of images with mildly varying distortion as would be found in 
video. 

Regarding claim 9, Gallagher discloses the image processing apparatus according to 
claim 1 . Gallagher does not explicitly disclose the range calculation is performed 
repeatedly, and a correcting magnification M is determined such that an image range 
after distortion correction processing comes within a predetermined range with respect 
to the input image range. 

Song et al. teach coordinates are successively updated based on which a distortion is 
corrected, and the process is repeatedly performed until the size of a scaled-up or 
scaled-down image is determined suitable to the screen ([0144]). 

Regarding claim 10, Gallagher and Song et al. disclose the image processing 
apparatus according to claim 8. Song et al. further teaches a range calculation is 
performed repeatedly, and a correcting magnification M is determined such that an 
image range after distortion correction processing comes within a predetermined range 
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with respect to the input image range (coordinates are successively updated based on 
which a distortion is corrected, and the process is repeatedly performed until the size of 
a scaled-up or scaled-down image is determined suitable to the screen, [0144]). 

Regarding claim 11, Gallagher discloses the image processing apparatus according to 
claim 1. Gallagher does not explicitly disclose the distortion correcting range calculating 
unit calculates an input image range for next distortion correction processing during 
executing the distortion correction processing by the distortion correcting unit. 

Song et al. teach a distortion parameter is successively updated until it converges to an 
accurate distortion parameter ([01 11]). This indicates the results of the current distortion 
processing affects the next distortion processing. 

Regarding claim 13, Gallagher discloses the image processing method according to 
claim 12. Gallagher does not disclose an input image range for next distortion correction 
processing is calculated during executing the distortion correction processing. 

Song et al. teach a distortion parameter is successively updated until it converges to an 
accurate distortion parameter ([01 11]). This indicates the results of the current distortion 
processing affects the next distortion processing. 
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Conclusion 

Any inquiry concerning tliis communication or earlier communications from tine 
examiner should be directed to MICHELLE ENTEZARI whose telephone number is 
(571)270-5084. The examiner can normally be reached on M-Th, 7:30am-5pm EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Vikkram Bali can be reached on (571)272-7415. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more Information about the PAIR system, see http://palr-dlrect.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Michelle Entezari/ 
Examiner, Art Unit 2624 



/Vikkram Bali/ 

Supervisory Patent Examiner, Art Unit 2624 



